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Abstract. We deal with finite dimensional linear and nonlinear control systems. If the system 
is linear and autonomous and satisfies the classical normality assumption, we improve the well 
known result on the strict convexity of the reachable set from the origin by giving a polynomial 
estimate. The result is based on a careful analysis of the switching function. We extend this result 
to nonautonomous linear systems, provided the time dependent system is not too far from the 
autonomous system obtained by taking the time to be in the dynamics. 

Using a linearization approach, we prove a bang-bang principle, valid in dimensions 2 and 3 for a 
class of nonlinear systems, afhne and symmetric with respect to the control. Moreover we show 
that, for two dimensional systems, the reachable set from the origin satisfies the same polynomial 
strict convexity property as for the linearized dynamics, provided the nonlinearity is small enough. 
Finally, under the same assumptions we show that the epigraph of the minimum time function has 
positive reach, hence proving the first result of this type in a nonlinear setting. In all the above 
results, we require that the linearization at the origin be normal. 
We provide examples showing the sharpness of our assumptions. 



1. Introduction 

In the theory of autonomous linear control systems, the assumption of normality, i.e., a strong 
controllabihty assumption requiring that if each control component is used separately, then Kalman 
rank condition is satisfied, is well known. In particular (see )15t Sections 14, 15, and 16]), normality 
implies that the control steering the origin to a point x in minimum time is unique and bang-bang; 
moreover the reachable set from the origin, TU , is a strictly convex body for all times r > 0. Simple 
examples, on the other hand, show that convexity of the reachable set is easily lost when passing to 
a nonlinear dynamics, even if the control covers all directions and appears linearly. In particular, 
the control system 

^^^^ \yi{t) =-[y2{t)Y + ui{t), -l<ni<l 

\y2{t) =U2{t) -1<U2<1 

which was analyzed in [6j, fails to have convex (and even normally regular, i.e., "without inward 
corners") reachable sets from the origin at any positive time. 

Similarly, the minimum time to reach the origin for a linear system is semiconvex, i.e., it is a 
quadratic perturbation of a convex function, provided a first order controllability assumption is 
satisfied (see [7]), or has epigraph with positive reach, i.e., it satisfies a quite good kind of 
generalized convexity, provided Kalman rank condition holds (see |lHll2j). On the other hand, the 
same example introduced above shows that such properties may fail even for a simple nonlinear 
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dynamics. 

We are not aware of any result of semiconvexity type valid for a nonlinear dynamics, where actually 
results of semiconcave type are more natural and easier to obtain, provided the target (or the 
dynamics) satisfy an inner ball condition (see [3 [3l [13l [TTl |3l E] ) . Further results on the regularity 
of the minimum time function T, for two dimensional systems with a single input control, are 
described in [21 Chapter 3], where in particular, under generic assumptions, a characterization of 
smooth and nonsmooth points of the level sets of T is given. 

In this paper, we give a contribution to the understanding of the behavior of the minimum time 
function both for linear, autonomous and nonautonomous, and nonlinear control systems. We take 
the origin as the target (or as the source, for the reversed dynamics), hence going outside the realm 
of semiconcavity, and give results, under easily verifiable assumptions, on the following topics: 

• strict convexity of the reachable set from the origin 

• uniqueness of the optimal control 

• a nonlinear bang-bang principle 

• extending backwards optimal trajectories 

• positive reach of the epigraph of T. 

Our method is based on new results on linear control systems satisfying the normality condition, 
and on linearization at the origin. The underlying idea, in fact, is requiring enough strength to 
such linearization, so that examples like (jl.ip are ruled out. Our linear results hold in any space 
dimension, while the nonlinear part is confined to two or three dimensional spaces. Our arguments 
are based essentially on a careful analysis of the switching function, namely the function whose sign 
is expected to determine the optimal control, according to Pontryagin's Maximum Principle. The 
point is exactly showing that this sign is well defined, except for at most finitely many zeros. To 
this aim, the normality assumption is pivotal, as it permits to split any finite interval into finitely 
many sets, each one being a disjoint union of finitely many intervals, where the switching function 
or its derivatives are uniformly bounded away from zero (see Lemma l3.2p . From this fact we are 
able to deduce a quantitative estimate on the strict convexity of the reachable set. More precisely 
(see Theorem 13. Sp . for a linear control system in we show that for all r > there exists a 
positive constant 7 > such that 

(C,2/-x)<-7||Clll|y-x|r for allx,yG7^^ CeN^rix) 

(here Nut^x) denotes the normal cone to TZ'^ at x). We show through an example that the exponent 
is optimal. Section [3] is devoted to the above topic, together with an auxiliary study for a linear 
nonautonomous dynamics. 

The nonlinear part starts with a nonlinear bang-bang result (Section[3|), valid up to dimension 3. We 
consider a nonlinear control system which is affine with respect to the control: if the linearization at 
the origin is normal, then every optimal control is bang-bang. The proof is based on Pontryagin's 
Maximum Principle: if the nonlinearity contains only parts which are of order larger or equal to the 
space dimension, then we are able to transfer to the switching function all the properties satisfied by 
the switching function of the dynamics linearized at the origin. This idea is at the basis also of the 
strict convexity of the reachable set for a nonlinear two dimensional dynamics (see Theorem 15. ip 
and of proving that all points close enough to the origin are optimal, i.e., any trajectory steering 
a point to the origin optimally can be extended backwards still remaining optimal (see Theorem 
16. 2p . In this case, the difficulty is extending the optimal control: our analysis permits to predict 
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backwards the sign of the switching function. Finally, we show under the same assumptions that 
the epigraph of the minimum time function T has positive reach, hence obtaining a rich bunch 
of regularity properties for T, as listed in Theorem 12.41 We also show through an example (see 
Example 15. 3p that the assumptions on the nonlinear part cannot be avoided, while (jl.ip shows 
that normality at the origin is essential. The restrictions on the space dimension for the nonlinear 
results will be explained after the relevant proofs (see Remarks 14.21 and 15. 4|) . 

To our knowledge, the results we present here as well as most of the used methods do not trace back 
to previous literature. In particular, the nonlinear bang-bang results of Krener [16] and Sussmann 
|19j seem to be of a very different nature. 

2. Preliminaries 

2.1. Nonsmooth analysis and sets with positive reach. 

In all the paper, the space dimension N will be supposed larger or equal to 2. 

Let K C be closed. The distance function to K and the projection mapping onto K are defined 

respectively by 

dxix) = min{||y-x|| : y £ K}, 
TTKix) = {y £ K : \\y - x\\ = dxix)}. 

The boundary of K is bdryii'. Given x £ K and v G M^, we say that w is a proximal normal to K 
at X (and we will denote this fact hy v £ Nk{x)) if there exists a = a{v, x) > such that 

{v,y — x) < (J \\y — x\\^ for all y £ K; 

equivalently v £ Nk{x) if and only if there exists p > such that itk{x + pv) = {x}, and in 
this case we say that the proximal normal v is realized by a ball of radius p > 0. If K is convex 
then Nk{x) coincides with the normal cone of Convex Analysis. The proximal subdifferential of a 
function / : Q ^ M at a point x of its domain, df{x), is the set of vectors v £ such that 

iv,-l) £ N^pi^j){x,f{x)), 

where epi(/), the epigraph of /, is defined as 

epiif) = {ix,y)£nxR:y>f{x)}. 

For an introduction to nonsmooth analysis we make reference, e.g., to [101 Chapters 1 and 2]. 
We will make use of the following concepts due to Federer [H]: given an arbitrary set K C M^, we 
set 

Unp(K) = {x G : ttk{x) is a singleton}, 
ieadi{K,x) = sup{r > : x + rB" C Unp(i^')}, 

the latter being defined for x £ K. We remark that reach(i^, x) is continuous with respect to 
x£K. 

Definition 2.1. We say that a closed K C has positive reach if 

reach(i^) := inf reach(i^, x) > 0. 
A locally closed set K has locally positive reach i/reach(/C, x) > for every x £ K. 
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The positive reach property is actually an external sphere condition with (locally) uniform radius. 
More precisely, it holds (see [15, §4]): 

Proposition 2.2. Let K C he closed. Then K has positive reach if and only if there exists a 
continuous function 99 : -ftT — t- [0, +00) such that the inequality 

(2.1) {v,y - x) <Lp{x)\\v\\\\y - 

holds for all x,y £ K and v € Nk{x). 

We say that / : — t- M is of class C"'^'^(il) (here VL C is open) if its partial derivatives exist 
and are Lipschitz. 

Remark 2.3. The case when f{x) = in ()2.ip is equivalent to the convexity of K, and (j2.ip is 

in this sense a generalization of convexity. Furthermore, it is easy to see that if the boundary of K 
is the graph of a C^'^ -function, then K has positive reach and ip in ()2.ip can be taken as constant. 
Hence positive reach property generalizes C^'"^ -manifolds as well. 

Lower semicontinuous functions whose epigraph has positive reach enjoy remarkable regularity 
properties, which are similar to properties of convex functions. In particular, the following re- 
sult holds true (we state it for continuous functions for simplicity). The Lebesgue A^-dimensional 
measure and the Hausdorff d-dimensional measure are denoted, respectively, by and T-L'^. 

Theorem 2.4. Let C be open, and let f : ^ M. be continuous, and such that epi{f) has 
locally positive reach. Then there exists a sequence of sets il/i C ^2 such that fi/j is compact in O 
and 

(1) the union of 0,^ covers -almost all Q; 

(2) for all X € VL^ there exist 5 = 6{x) > 0, L = L{x) > such that 

f is Lipschitz on B{x,5) with ratio L, and hence semiconvex on B{x,5). 
Consequently, 

(3) f is a.e. Frechet differentiable and admits a second order Taylor expansion around a.e. 
point of its domain. 

Moreover, the set of points where the graph of f is nonsmooth has small Hausdorff dimension. 
More precisely, 

(4) for every k = 1,...,N, the set {x G intdom(/) | the dimension of df{x) is > /c} is 
countably -rectifiable. 

Finally, 

(5) f has locally bounded variation in Vl. 

This result is essentially Theorem 5.1 and Proposition 7.1 in [llj. For properties of semicon- 
vex/semiconcave functions we refer to [7]. 

2.2. Control theory. We will consider control systems linear or nonlinear with respect to the space 
variable and affine and symmetric with respect to the control. More precisely, we will consider the 
linear control system 

y{t) = Ay(t) + Bu{t) a.e. 

(2.2) <^ u{t) eU = [-1,1]^ a.e. 

, y(0) = 0, 
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(2.3) 



where 1 < M < and A G MjvxAf, B G MjyxM, being possibly time dependent, and U = 
[—1, 1]*^ B (til, • • • , um) ='■ u, together with the nonhnear control system 

' y{t) = F{y{t)) + G{y{t))u{t) a.e. 
u{t) e [-1,1]^'^ a.e. 
y(0) = 0, 

where F and G are suitable vector fields (the actual assumptions will be stated later). We will 
use also the notation B = {bi, . . . , Bm) or G = {gi, . . . , gu), where each entry is an A^-dimensional 
column. We denote by Uad, the set of admissible controls, i.e., all measurable functions n, such 
that u{s) G U for a.e. s. For any u{-) £ Uad, the (unique, as it will follow from the assumptions on 
F and G) Caratheodory solution of (|2.2p or of ()2.3p is denoted by y"(-)- In the linear case. 







so that the reachable set from in time t can be described by 

(2.4) 7^* = [J^ e^'^'-'^Bu{s)ds) \ n(-) G Uad}- 

It is well known that in the linear case the set 7^* is convex and compact (see, e.g., \15\ Lemma 
12.1]), while in the nonlinear case ()2.3p TV" := {y^{t) \ n(-) G Uad} is compact and not necessarily 
convex (see, e.g., |Sl Chapter 10]). 
For a fixed x G M^, we define 



e{x,u) := min {t > | y^'"(t) = 0}, 

where y^''"(-) denotes the solution of y = F{y) + G{y)u such that y(0) = x. Of course, 6{x,u) G 
[0,+oo], and 9{x,u) is the time taken for the trajectory y^''"(-) to reach 0, provided 9{x,u) < +oo. 
The minimum time T{x) to reach from x is defined by 

(2.5) r(x) := inf {^(x, u) \ n(-) G U^d}- 

Observe that the sublevel TZt = {x : T[x) < t} of r(-) equals the reachable set from the origin 
within the (same) time t for the reversed dynamics 

X = —F{x) — G{x)u, u gU. 

If u is an admissible control steering x to the origin in the minimum time T{x) (i.e., an optimal 
control), then the Dynamic Programming Principle (see, e.g.. Proposition 2.1, Chapter IV, in 
[1]) implies that T(-) is strictly increasing along the optimal trajectory y^'". Therefore, for all 
< t < T{x) the point y^''^{t) belongs to the boundary of TZt- 

Pontryagin's Maximum Principle is a fundamental tool for the analysis of optimal control prob- 
lems. We state it for points belonging to the boundary of reachable sets. In view of the previous 
remark, this will apply also to points belonging to optimal trajectories. We give first its linear 
version. 

Theorem 2.5 (Pontryagin's Maximum Principle for linear systems). Consider the problem (|2.2p . 
fix T > 0, and suppose x G 71^ is realized by the control u{-) G Uad (i-e., y^{T) = x). Then 
X G bdryT^-^ if and only if for some C, G N-j^t{x), C ^ 0, it holds 

(2.6) Ui{t) = sign(C,e^(^-*)6,), a.e. t G [0,r], 
for alli = l,2,...,M. 
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A well known reference for this result is [15, Lemma 13.1]. 

Before stating Pontryagin's principle for the nonlinear case (|2.3p (with M = 1), we need to 
introduce the Maximized Hamiltonian. 
We define for every triple {x,p,u) E x x [-1,1] 

'H{x,p, u) = {p, F{x)) + u{p, G{x)) 

and 

H{x,p) = max{7i{x,p, u) : u £ [—1, 1]}. 
Then Pontryagin's principle reads as follows (see, e.g., [2} Section 2.1] or jO! Theorem 3.5.4]). 

Theorem 2.6 (Pontryagin's Maximum Principle for nonlinear systems). Fix T > and let y" be 

a trajectory of ()2.3p such that y^{T) belongs to the boundary of TZ^ . Then there exist a function 
A : [0, r] —7- M^, never vanishing, and a constant Aq < such that for a.e. t G [0,T] one has: 

i) \{t) = -\{t){DF{y-{t)) + DG{y^{t))u{t)), 

ii) ■H{y^{t),\{t),u{t))+\^ = Q, 

iii) 'H{y^{t),\{t),u{t)) = H{y^{t),X{t)). 

Furthermore, 

A(T)GiV^T(y"(T)) 
where here N'j^T{y^{T)) denotes the Clarke normal cone. 

Definition 2.7. We say that a control u is essentially determined by Pontryagin's Principle if for 
any ui satisfying iii) in Theorem \2.6\ (for the adjoint curve A associated with the trajectory one 
has ui{t) = u{t) a.e. in [0,T]. 

In the following we will make extensive use of the classical concept of normality for linear systems, 
which we are now going to introduce. 

Definition 2.8. The system \2. ^} is normal if and only if for every column bi of B , i = 1, . . . , M , 

we have 

Rank[bi,Abi, A^'^b^] = N. 

The main classical result for normal linear systems is concerned with the reachable set. 

Theorem 2.9. Assume that the linear control system^K^ is normal. Then the reachable set TZ^ 
is strictly convex for any T > 0. 

Proof. One can find a proof in [15J, Sections 14 and 15. □ 

Remark 2.10. // the system Ii2.2\) is normal then {A,B) satisfies the Kalman rank condition. 
Therefore the minimum time function is everywhere finite and continuous ( actually Holder contin- 
uous with exponent 1/N, see, e.g.. Theorem 17.3 in [15] and Theorem 1.9, Chapter IV, in [Ij and 
references therein). 
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3. Quantitative strict convexity of reachable sets: the linear case 
3.1. Autonomous systems. 

This subsection is devoted to improving the classical result on the strict convexity of reachable sets 
for normal linear control systems of the type ()2.2p . We will give an estimate for the boundary of 
reachable sets which implies a uniform (polynomial) strict convexity with an optimal exponent. 
In the first Lemma we define the switching function and begin studying its behavior under the 
normality assumption. 

Lemma 3.1. Let A G Wl^xN and b G be such that 

(3.1) Rank[b, Ab,..., A^-^b] = N. 
Take C S , with \\(^\\ = 1, and define, for s € [0, +oo) 

(3.2) g{s) = {e^% , ()■ 

Then there exists a constant C, depending only on A, b, N such that, for all s G [0, +oo), 

Af-l 

(3.3) j;i/')(.)|>£e-"-^IK 
Proof. Set 



i=0 



K = {b, Ab, A^-i' 



and observe that, by (|3.ip 

(3.4) C = min ||KC|| > 0. 



=1 



Fix C G with ||C|| = 1 and write Ci(s) = e^^^C- Observe that C = e'^'^'Ciis) and ||Ci(s)|| > 
g-^ll^ll. We compute now, for i = 0, 1, . . . , — 1, 

(3.5) g^^\s) = {e'''A\0 = {A\Ciis)). 

Therefore, 

KCiis) = (b, Ab, A^-^b) (lis) 

||KCi(s)ll >/:e-^"^ii. 

Af-l 

\\KCiis)\\<J2\9^'Hs)\ 

i=0 

and the proof is concluded. □ 

The next Lemma is crucial for estimating the number of zeros of the switching function g (cor- 
responding to the number of switching points of the optimal control associated with g) and for 
studying their multiplicity. We recall that the constant C was defined in (j3.4p . 



Using (j3.4p we have that 
On the other hand. 
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Lemma 3.2. Let A G MnxN and b e be satisfying i TO]) . Take ( £ , ||C|| = I, and fix 
T > 0. Let g{s), s e [0,r], be defined as in < rO|) . 

Then there exist disjoint sets /q, • • • ,Ln-i and numbers Mi, depending only on A,b,T and N 
such that 



Af-l 



i=0 

and, for all i = 0,1, N — 1, the set li is the disjoint union of at most Mi intervals. Moreover, 
for each i = 0,1, . . . ,N — 1, for all s G li, we have 

(3.6) |<^W(,)|>|e-||A|K 
Proof. We proceed by induction for i from to — 1. Set 

(3.7) c{s) = 
and 

Jo = {sG (0,r) I \g{s)\ <c(s)}. 
Since Jq is open, we can write it as the disjoint union of at most countably many open intervals, 

oo 

(3.8) Jo = U 4- 

k=l 

We assume, without loss of generality, that there are at least such intervals. Fix now any number 
N' > A^, and take a subfamily of the intervals Jq consisting of at most N' elements. Without loss 
of generality, we can rearrange their indexes k so that Jq = (a2A;, a2A;+i)) where 1 < k < N' and 
< a2 < as < a4 < as < . . . < a2fc < a2fc+i • • • < a27V'+i < T. 

Now, fix k and consider the intervals (02^, a2fc+i), . . . , (a2(fc+Af-i)) fl2(fc+Af)-i). Set, for j = 
0,1,..., N-1, 



and, for j = 0,1,..., A^- 2 
Observe that 



[02(fc+i)+l'«2(A:+j+l)] ■- 



N-l N~-2 

U -V ^ U = («2fc,a2(fc+Ar)-l). 
3=0 j=0 

We are going to give a lower bound on |a2(fc+7v)-i — a2k\ which will turn out to be independent 
of both k and A^'. From this fact it will follow automatically that the intervals (02^702^+1) are 
nonempty only for finitely many k. 

Observe that for each j = 0,1, . . . , N — 2, there exists at least one point cj G Ij' such that 
g'{cj) = 0. Therefore, there exist at least N — 2 points, say cj, for j = 0, 1, . . . , A^ — 3, such that 

Cj G {c],Cj_^_l) and g'icj) = 0. 

Proceeding by induction we see that, for each i = 1, . . . , N — 1, there exists at least one point 
Ci G (a2A:+i,a2(fc+Ar)_i) such that g'^'^Ci) = 0. 
Pick any sq G (a2fc, a2A:+i). We have 

(3.9) \g{so)\ < c(so). 
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and, for i = 1, . . . , — 1, 



< / \9^'+'Hs)\ds < (a2(,.+^).i - a2fc)ell^ll^P^+i6||, 

where the last inequaUty is due to ()3.5p . Therefore, 

N-l N-1 

(3.10) Yl < {a2ik+N)-i - a2fc)ell^ll^ ^ P^+^ftH. 

i=l i=l 

On the other hand, recahing (j3.3|) . (|3.7|) . and (|3.9p we have 

(3.11) E |5«(.o)| > - c(«o) = ^£e-ll^ll- > ^Ce-^^W^. 
1=1 

From (jS.lOp and p.lip we obtain 

, , (N - l)£e-2|l^ll^ 

(3-12) a2ik+N)-i - a2k > ^ ^^^-i ' 

which is the desired estimate. Observe that the right hand side of (|3.12p depends only on A, b, T 
and N. 

We set now A/q to be the number of nonempty intervals contributing to the union in (j3.8p . and 
recall that we have just proved that A/q depends only on b, T and N, and actually 

(3.13) Mo < ^^e'"^'"' E U'-^'H 

i=l 

Set /q = [0, T]\Jq and observe that we have completed the proof of the lemma for i = 0. 

After this step, we formulate our induction process. We are going to construct, for each i = 
0, . . . , N — 1, two disjoint sets /j, Jj with the following properties 

(indl) for every s £ li, \g^^\s)\ > c{s); 

(ind2) for every s E J,, Ef~'+i \9^'\s)\ > {N - i - l)c(s); 

(ind3) Ji\JIi = Ji_i; 

(ind4) Ji is a finite union of open intervals whose number is at most A/i, and A/i depends only on 
T,£,A,b,N,i; 

(ind5) li is the finite union of at most Mi + A/i-i intervals. 

For i = the above construction was already performed (take J_i = (0, T)). Pick any i = 
1, . . . , N — 2 (the case i = N — 1 will be treated separately) and assume that (indl), . . . , (indS) hold 
up to i — 1. We wish to show that the above statements hold for i as well. To this aim, consider 
the set 

J, := {sG J,-i I \g'^'\s)\ <c(s)}. 

For every connected component (a, 6) of Jj-i, we are going to prove that J-"''''^ := Ji n (a, 6) is a 
finite union of intervals, and give a bound on their number M^""'^^ . 

So, fix a connected component (a, b) of Ji and represent the open set 4"'*^ disjoint union of 
at most countably many intervals j/^, /c G N (for simplicity of writing we drop the dependence on 
(a, b)). Assume without loss of generality that there are at most N — i intervals Jf , fix any number 
A^" > N — i, and take any subfamily of { Jf } consisting of at most A^" intervals. We can write 
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= {a2k,ci2k+i), where 1 < A; < N" and a < a2 < 0,3 < 0,4 < < . . . < a2N"+i < b. Fix k and 
consider the intervals (02^, a2fc+i), • • • , {a2(^k+N-i-i),a2{k+N-i)-i)- Set, for j = 0, . . . , - i - 1, 

(«2(fc+j)) a2(fc+i)+i) ■= ' 

and, for j = 0, . . . , — i — 2, 

{(^2{k+j)+l,0'2{k+j+l)] ■=^j^- 

Observe that 

Af-i-l N-i-2 

U U = ("2fc,a2(fc+^r-^)-l)• 

J=0 j=l 

For each j = 0, . . . , N—i—2 there exists at least one point c*- G Ij' such that g^^^ (c* ) = 0. Proceeding 
by induction we see that for each m = 0, ...,A^ — i — 2 there exists a point Cm € (02^+1, CL2{k+N-i)-i) 
such that g^^^"^\cm) = 0. Pick any sq S (02/^02(^4.1)). By arguing as for i = 0, we obtain on one 
hand 

(3.14) l5^')(so)| <c(so) 
and, for all m = 0, . . . — i — 1, 

|5(*+™)(so)| < (a2(fc+;v-0-i-a2fc)ell^ll^||vl*+"+i6||, 
the latter inequality being due to (j3.5p . Thus 

AT-l 7V-1 

(3.15) Yl l5^™^(«o)l<(a2(fc+7V-0-i-a2fe)ell^ll^ J] 

m=i+l 171=1+1 

On the other hand, owing to (ind2) and ()3.14p . we obtain 

N-l 

E \g'^'^\s)\>{N-i-l)c{s,). 

m=i+l 

By combining the above inequality with (j3.15p we now obtain 

N -i-l ^ -llAIIT 1 



a2,k+N-.)-. - a2k > -^^^e- ^^^^^^^^^ . 

Therefore, J^^"'''^ is the union of finitely many disjoint open intervals (02!^' '^2l+i) ' k = 1,. . . ,J\f-°''''\ 
where 

(3.16) Mt''^ < y^~^^'^~"' eW y + AT _ , _ 1. 

m=i+l 

We define 

/('^■'') = {sG (a, 6) I >c{s)} 
and observe that is the union of at most M^'^'^^ + 1 intervals. 

We finally set to be the union of the /f"^'''^^ over all the (at most Afi-i) connected components 
{aj,bj) of Jj-i. Therefore, Ij is the union of at most A/i + A/i_i intervals, where 

(3.17) AA.= ^AA^'^-)< ^^^^_^j ^eW y \\A-+^b\\+^^..,{N-^-l). 

j=l m=i+l 
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Finally we observe that Jj is the union of at most Ni open intervals. 

If i = — 1, we observe that for each s E Jn-2, recalling (ind2) we have \g^^-'^Hs)\ > c{s). 
Therefore we set Jn~i = and In-i = Jn-2- The proof is concluded. □ 

We are now going to prove the main result of this subsection. 
Theorem 3.3. Consider the linear control system 
(3.18) x = Ax + Bu, 

where 1 < M < N, Ae MnxN, B G MnxM, and u = {ui, . . .,um) G [-1, 1]*^. 
Assume that 113.18]) is normal, i.e., for every column bj, j = 1,. . . ,M, of B, 

rank [bj,Abj, A^'^bj] = N. 

Let TZ^ he defined according to (|2.4p . Then for all T > there exists a constant 7 > 0, depending 



only on N, M, A, B, T such that for all x, y G , for all C £ ^tzt{x), the inequality 

(3.19) ll^ll 

holds. Moreover, there exists another constant 7', depending only on N,M,A,B,T, such that 

(3.20) the ball B{0,'y'T^) is contained in . 

for all T > 0. Finally, the constants 7 and 7' are bounded away from zero as T — ?■ 0^. 
Proof. We consider first the case M = 1, so (j3.18p reads as 

X = Ax + bu , \u\ < 1, 

for a suitable b G M^. Fix x G bdryT?."^ together with an optimal control n(-) steering to a; in 
time T and C £ ^'rt{x), \\C,\\ = 1. We assume first that C, satisfies Pontryagin's maximum principle, 
i.e., for a.e. t G [0, T], 

t2(0 = sign(C,e^(^-*)6) 

and prove (j3.19p for such C,. The general case will then follow using Proposition 17. 3i 
So, we take y G TZ^ together with a control u(-) steering to y and compute: 

(C,y-x) = C {C.e^^^-'h){u{t)-u{t))dt 
(recaUing (fZB ) 

T 

|(C,e^(^-*)6)| \u{t)-u{t)\dt. 









Set K{t) = \\u{t) - u{t)\ and observe that < K{t) < 1 for a.e. t G [0,r], and 

(3.21) (C,y-x) = -2 r\{C,e^^^-%)\K{t)dt = -2 \{C,e^%\K{T - t)dt. 

Jo Jo 

Moreover, 

rT _ _ /-"^ 

(3.22) \\y-x\\ 



f e^^'^-'h{u{t) - u{t))dt < 2e^ll^ll||6|| /" K{t)dt 
Jo Jo 



Set, for s G [0, +00), 

g{s) = {e^% , C). 
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By Lemma [32] there exist disjoint sets Io,Ii, . . . , In-i and numbers Mi such that [0, T] = (j£o^ 
each li is the disjoint union of at most Mi intervals and (j3.6|) holds. Observe that, in particular, it 
follows that g may vanish at most at finitely many times, and so, recalling ()2.6p . the control u is 
piecewise constant and equal to either 1 or to —1. 
We rewrite 

N-l „ 

(3.23) {C,y-x) = -2j2 \9(.s)\Ki{s)ds 

where Ki{s) = K(T — s). We are now going to estimate separately the integrals Jj \g{s)\Ki{s)ds, 
for alH = 0,l,...,iV-l. 
For i = 0, we have 

(3.24) / \g{s)\Ki{s)ds > ^e-\\^\\^ [ K,is)ds. 

Jlo Jlo 



Fix now i = 1,2, . . . , N — 1, and write, recalling Lemma 13.21 

M 

li = [Jio-ij^bij] 

i=i 

where all open intervals {aij,bij) are disjoint. Recalling (j3.6p . we have, for all s G /j, |g^*^(s)| > 
■^e"""^""^. Fix j G {1,2,... ,Mi}. We are now going to apply inductively Lemma 1712] on [aij,bij] 
with the functions g^^~^~^^ in place of /, for k = 0, . . . ,i — 1. Let k = and set / = 5^*"^^. Then 
the assumption (|7.1|) is satisfied with C = -^e"""^""^, thanks to (|3.6|) . and Lemma 17.21 vields that 
for some point c^j £ [aij,bij] we have 

\g^'-'Hs)\ > C\s - c'^^l ysG[aij,bij]. 

Let k = 1. By applying Lemma [7.21 on each of the two (possibly degenerate) intervals aij,c^j, 
c^j^bij to the function / = 5^*^^^ with C = ^e"""^"'^, we find suitable points G and 
c?j G [c^j-:bij\ such that we have both 

\g^'-'Ks)\ > ^{s-c]^f V.gK,4] 

and 

By continuing the induction process until k = i — \, we split the interval [aij,bij\ into at most 2* 
intervals [ojj = c°-, , [c\^, cfj], . . . , [c^j~^, hj = cfj] (some of them being possibly degenerate) such 
that for ah / = 0, 1, . . . , 2* — 1 and s G [c'^, c'^^] one has 



(3.25) either 15(^)1 > ^{s - 4^y or 15(^)1 > ^{^^ 

Recalling (|3.23p and the above discussion, we have 



iCy-x) = -25^ / \g{s)\Ki{s)ds 

j \g(s)\K^{s)ds+J2T.Iir \9{s)\K,{s) ds 
-^^0 i=l j=0 1=0 '^'^ij 



N-lAfi-l2'-l „c'+i 
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Recalling ()3.24p and (|3.25p . and C = j^e we obtain from the above expression that 



2£ 

(3.26) (C,y-x)<-— e- 



IIAIIT 



Af-1 M-l 2^-1 ^^i+i 



Ki{s)ds 



i=l j=0 1=0 -"-ij 



where c\j is either c-^ or c[^^, according to the two possibilities appearing in (|3.25p . Applying 
Lemma l7. II to each summand of ()3.26p we therefore obtain 



{C,y-x) < -2|e-ll^ll^ 



Jin .-I .-n 7_n 



i=l j=0 1=0 

(using the convexity of x i— )• x*"*"^ on the positive half line) 



< 



< 



2C 

-IT' 

2C 



'U\\T 



N-1 



lo 



^ (i + l)! 2^M^ 



Ki{s)ds 



i+l 



Thus, recalling that < Ki{s) < 1 a.e., 



(3.27) 



Ki(s)(is 



lo 



N 



N-1 



+ E 



- (i + l)! 2^'M,%\^-^-^\Ji^ 



Ki{s)ds 



N 



Owing to (f333]l and (l3T7l) . we see that Mo < Mi < . . . < Mn < C{A, b, iV)e2|l^ll'^ where C{A, b, N) 
depends only on A, b, N. Therefore, we obtain finally from (j3.27p and the definition of Ki that 



(3.28) 



iCy-x) <-C{A,b,N,T)e 



-\\A\\T 



\u{t) - u{t)\ 



N 



where C{A, b, N, T) is a positive constant, depending only on A, 6, A^, T such that 



(3.29) 



liminf C(A,6,7V,r) > 0. 

T^O 



Recalling ()3.22p . we complete the proof for the case M = 1 (i.e., a scalar control) by setting 

^ = 2-^e-ll^ll(^+i)^||6|r^C(^,6,Af,r). 

Let now M > 1. Take x G bdryT^-^ together with an optimal control u(-) = ('Ui(-), . . . ,um{')) 
steering the origin to x in the optimal time T, and y € V?" with a control u(-) = (ui(-), . . . , um{-)) 
steering the origin to y in time T. Then, for each C, £ Nf^T{x), ||C|| = 1, we can write 

(3.30) {C,y-x)< (C, e^^^-'^Bw{s))ds = V / (C, e^^^'%){u,{s) - u^{s)) ds, 

Jo ^0 

where B = (bi^.^-^^^ ^. Recalling (|2.6p we have also 



M „r 



(3.31) 



iCy-x) 



E / \{Ce^(^-^^'^)\\u,{s)-u,is)\ds. 
i=i Jo 
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N 



Moreover, 

M T 

(3.32) < el'^ll^ V||6i|| / \ui{s) -Ui{s)\ds. 

^=l Jo 

We now apply the same argument leading to (j3.28p to each summand of the right hand side of 
(|3.30p . Therefore we obtain, using (|3.3ip . that 

M „r 

(3.33) (C,y-x) <-C7'(A,5,r,iV,M)e-II^II^J^( / \u^{s) - Ui{s)\ d.s'^ 

1=1 •'0 

where the positive constant C depends only on A, B ,T, N, M and 

liminf C"(^, 5, T,iV,M) > 0. 

T-5-0 

We conclude the proof of (|3.19p by applying (|3.32p and setting 

7 = 2^e-(^+i)ll^!I^C"(^, B, T, N, M), 

where C" is a constant enjoying the same properties as C. 

In order to prove the statement concerning the ball contained in TZ^ , observe that the inequality 
()3.33p with u = and y = 0, taking into account that the control u is necessarily bang-bang, 
becomes 

{C,x) > C'{A,B,T,N,M)e-\\'^\\'^MT^ , 
from which (taking \\C,\\ = 1) we obtain 

(3.34) ||x|| > C'{A, B, T, N, M)e-II^II^Mr^ := j'T^ . 

The above inequality yields in particular that belongs to the interior of 7^"^. Since Ti^ is convex 
and (irap holds for all x G bdryTl^, IK20\i follows. 

The last statement follows from ()3.29p and the explicit expressions for 7 and 7'. The proof is 
concluded. □ 

Remark 3.4. The exponent N in i3.19\) is optimal. 

In fact, consider the dynamics 

Let xi(-) be the solution corresponding to the control u = 1. Fix s > and let Xs{-) be the solution 
corresponding to the control 

1 0<t<s 
-1 s <t. 

Fix any T > and observe that xi{T) = /Nl, while, for < s < T, 

:r,(r)-xi(r) = ^(r-.)^. 

Observe also that \xi^ — x[^ ^\t)\ = 2\T — s\, so that setting Xi = {xi,x[, . . . jX^^ ^^), 

i = l,s, one obtains 



Usit) 



(ei,X,(T) - X,iT)) = ^(T - .)^ > -7||X,(T) - X,iT)f, 

for a suitable positive constant 7. If s — )■ T, then Xs{T) — t- Xi{T), and this shows that A'^ is the 
smallest exponent allowed in (j3.19p . □ 
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3.2. Nonautonomous systems. 

The following Lemma is a first step for studying the reachable sets in the case of nonlinear 
control systems by using the linearization approach which we design in this paper. We will prove 
that under the rank condition (normality) at of the linear nonautonomous control system ()3.35p , 
the strict convexity of the reachable sets is preserved up to a sufficiently small time, provided A{t) 
and B{t) are not too far from A{0), -B(O). Sufficient conditions for the validity of the assumptions 
if = 2 will be given below. In Section [J] sufficient conditions in the case where A and B come 
from a linearization around a trajectory will also be given. 

Let A : M"*" — )• MnxN and B : — )• MjvxM, 1 < M < A^, be measurable and consider the linear 
nonautonomous control system 

(3.35) x{t) = A{t)x{t) + B{t)u{t), 
together with 

(3.36) x(t) = A{0)x{t) + B{0)u{t), 

where u = (ui, . . . , um) G 1]^^- We denote by {■, •) the matrix solution of 

'' ^X{t, s) = X{t, s)A{t) for t,s>0 



(3.37) 

and by Mq •) the matrix solution of 
(3.38) 



dt 

M{s,s) = I 



f X(t, s) = X{t, s)A{0) for t,s>0 
Mo(s,s) =1 



Let b{-) be a column of B{-), let T > and define, for any ( S M^, 

(3.39) g{t) = {CM^iT,t),b{t)), 
and 

(3.40) go{t) = {CMj{r,t),b{0)). 

Observe that g and go can be seen as the switching functions related to (|3.35p and (|3.36p . respec- 
tively. 

We state now an abstract result which permits to transfer to g some properties of go and to establish 
the quantitative strict convexity estimate for the reachable set from the origin of (j3.35p . Sufficient 
conditions in order to apply the following lemma to suitable linearizations in dimension 2 and 3 
will be given in Section [H 

Lemma 3.5. Fix ( G M^, \\C,\\ = 1, and let g and go be defined according to \3. 39^) and ()3.40p . 
respectively. Assume that 

(i) rank[6(0), ^(0)6(0), . . . ,^^"^0)6(0)] = A^; 

(ii) g is N — 2 times differentiable and g^^~'^^ is absolutely continuous; 

(iii) there exists a constant K = K{A, B) and a time T' such that for all i = 0, . . . , N — 1 one 
has 

Ig^'Kt) - 9o\i)\ ^ V all 0<t< T'. 
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Let C be defined by (|3.4p . with A{0), 6(0) in place of A, b, respectively. 
Then there exists T = T{A, B, N, T') with the following property: 

for every < t < T there exist disjoint sets li and numbers Mi, i = 0, . . . , N — 1, depending only 
on A{0),B{0),T, such that 

(a) [0,T]=UZ~o'li; 

(b) each li, i = 0, . . . , N — 1 is the disjoint union of at most Mi intervals; 

(c) for each i = 0, . . . , N — 2 and each s £ li 

(d) g^^^'^^ has constant sign in every connected component of In-i and, for each s G In-i 

Remark 3.6. Iq,. . . ,In-i oif^ exactly the intervals constructed in Lemma \3.2\ with go in place of 
9- 



Proof of Lemma 13.51 Let Lq, . . . ,In-i be the sets appearing in the statement of Lemma 13.21 
with go in place of g, so that, in particular, (a) and (b) hold. Moreover, for each s G li we have 

Therefore, if KT < 2^e-ll^(°)ll^ also (c) and (d) hold, owing to (iii). □ 

Remark 3.7. Sufficient conditions for the validity of the assumptions of Lemma 13.51 in the case 
N = 2. 

Let N = 2. Sufficient conditions for the validity of assumptions (ii) and (iii) in the above Lemma 
are the following: 

(Co) A{-) is measurable and 

\\A{t)-A{id)\\ < Lt for all t > 0; 

(Ci) B{-) is absolutely continuous and 

d 



< 2Lt for ah t > 0, 

where L is a positive constant. 
Observe that condition (Co) implies that t = is a continuity point for A{-), so that A(0) in (Co) 
is meaningful. □ 

As an immediate corollary of Lemma 13.51 we obtain the following 

Theorem 3.8. Consider the linear nonautonomous control system ()3.35p under the assumptions 
of Lemma (|3.5p . Let denote the reachable set at time r > from the origin for (|3.35p . Then 
there exist a time T = T{A,B,N) > and a constant 7 = ^{A,B,N) > such that for every 
< T < T, for every x,y G , for every C, £ Nht[x), we have 

(C,y-x)<-7llCIII|y-x|r. 

Moreover, there exists another constant 7' = 'y'{A,B, N) > such that for every < r < T 
(3.41) the ball B{0,j't'^) is contained in TZ^. 
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Proof. The argument developed in the proof of Theorem l3.3l can be used also in this case. Indeed, 
fix X G bdryT^"^ together with a control u(-) steering to x in time r and let C £ ^TZ'^ix), \\(\\ = 1, 
be such that 

(3.42) u{t) = sign(C, b{t)M{T, t)) for a.e. t G (0, r) 

(here, as at the beginning of the proof of Theorem 13.31 we assume that B = b is a vector, i.e., the 
control is scalar). 

Then the proof proceeds exactly as for Theorem 13.31 provided that g is given by 

g{t) = {C,b{t)M{T,t)), 

so that for all y € TZ'^ one has 

N-l „ 

(C,y-x) = -2 V / \g{s)\K,is)ds, 

where Ki{s) = \\u{t — s) — u{t — s)|, u{-) is the control which steers the origin to y, and the sets 
li are those appearing in the statement of Lemma 13.51 □ 

4. A NONLINEAR BANG BANG PRINCIPLE IN DIMENSIONS 2 AND 3 

Starting from the present section we will deal with nonlinear control systems, which are affine 
and symmetric with respect to the control. This section is devoted to giving sufficient conditions 
so that controls steering the origin to the boundary of the reachable set are always bang-bang, 
provided the final time is sufficiently small. More precisely, the following result holds. 

Theorem 4.1. Let N = 2 or N = 3. Consider the control system 

^4^^ fx(t)= Fixit))+Gix{t))u{t), 

\x{0)= 0, 

where 1 < M < N, n(-) = (mi(-), . . . , tiM(-)) 6 [-1,1]^ «-e., and F : ^ and G = 
(Gi, . . . , Gm) '■ — ^ M^vxM satisfy the following assumptions: 

(i) F and G are of class C^~^ and all partial derivatives are Lipschitz with constant L; 

(ii) F{0) = 0; 

(iii) rank[Gi(0),Z)F(0)Gi(0),...,(DF(0))^-iGi(0)] =iV for i = 1, . . . , M ; 

(iv) ifN = 3, then DG{0) = and D^F{0) = 0. 

Let TZ^ denote the reachable set of ()4.ip at time r > 0. Then there exists T > 0, depending only 
on DF{0), G(0), L, N, such that for every < t < T the following properties hold: 

(a) every admissible control u{-) such that the corresponding trajectory y"(-) of (|4.ip at time r 
belongs to the boundary of is essentially determined by the curve \{ ), the solution of 
the adjoint equation 

= -\{t) {DF{y^{t)) + DG{y^{t))u{t)) 
= C^Nn^{y^{T)), ||C|| = 1, 
through the identity 
(4.3) ^x(t)=sign(A(t),G(y"(t))) a.e.; 

(b) u is hang-bang, i.e., u{t) E { — 1,1}*^ a.e., and is piecewise constant; 



(4.2) 
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(c) the maximum number of discontinuities of u depends only on DF(0), G{0), L, and N. 

Proof. We consider first the case where M = 1, i.e., G{x) is a vector and the control u is scalar. 
Fix T > and an admissible control u such that x := y'^{T) G bdryT^"^. By the Maximum Principle 
(see Theorem 12. 6p there exist C, G N-jirix), \\C,\\ = 1, and an adjoint curve A(-), a solution of ()4.2p . 
such that u satisfies (|4.3p . Proving (a), (b), and (c) amounts to showing that the switching function 
(A(t), G{y'^(t))) vanishes at most finitely many times in [0, r] and the number of its zeros depends 
only on DF{0), G(0), L, and N. 

For convenience we rewrite the switching function in the following way. Let M^(-,-) denote the 
matrix solution of I^M), with A{t) = DF{y''{t)) + DG{y''{t))u{t), and set b{t) = 
t e [0,r]. Then 

g{t) := {\{t),b{t)) = {C,b{t)M{T,t)). 

Let also Mq{-,-) be defined by (|3.38p . where ^4(0) = DF{0), and let go be defined according to 
()3.40p . We wish to apply Lemma [331 to the above introduced mappings g and ^o- 
First of all, we compute g' and observe that it is continuous. Indeed, 

g\t) = (C,6'(t)M(r,t)) + (C,6(t)^M(r,t)> 

= (C, Z)G'^(y"(t))y"(t)M(r, t)) + {(, -b{t)A' {t)M{T, t)) 
= (C,DGT(y«(t))(F(y«(t)) + G(y«(t)Mt))^M(r,t)> 

+(C,-G"^(y"(t))(i?F(y"(t)) + DG(y-(t))n(t))^M(r,t)> 
= (C, {DG'^{y^{t))F^{y^{t))-DF^{y^t))G^{y^{t)))M{T,t)) 
= {X{t),[F'',G^]iy^t))), 

where [F^,G^]{x) := DG'^{x)F^{x) - DF^{x)G^{x) denotes the Lie bracket. 
Moreover, if = 3 g'' is a.e. differentiable and we have 

g"{t) = (A(t),[FT,GT](y«(t))> + {X{t),^^[F^,G^]{y^{t))). 
Finally, observing that g'^it) = {(, -DF^ {0)G'^ {0)Mo{T,t)) = {CM^{T,t), [FT,GT](0)), we have 
g'{t)-g',{t) = (C(MT(r,t)-Mo^(r,t)),[FT,GT](y«(t))> 
+ (CMo^(r,t),I)G^(y"(t))FT(y"(t))> 
+ (C, (Z)FT(O) -I)FT(y«(t)))GT(y"(t))> 
+ (C,DFT(0)(GT(0)-GT(y«(t)))) 
= I + II + III + IV. 

We are now going to estimate separately each summand of the above expression. 
First, we observe that, thanks to the assumptions (i) and (ii), we have 

\\M{T,t)-Mo{T,t)\\ < f {\\A{s)\\ ||Mo(r, -M(r, + ||Mo(r,s)|| \\A{Q) - A{s)\\) ds 



< Ki I \\M{t,s) - MQ{T,s)\\ds + K2t^ 
Jo 



where Ki and K2 are suitable constants depending only on DF{0), G{0), L, and r. Gronwall's 
lemma therefore yields 

||M(r, t) - Mo(r, < Kgt^ for ah t £ [0, r], 
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where the constant depends only on Ki, K2. Therefore, there exists a constant Kj, depending 
only on DF(0), G{0), L, and r such that 

(4.4) |/| < Kit"^ for all t £ [0,r]. 
Assumptions (i) and (ii) yield in turn 

(4.5) \II\ < Kiit for all t e [0,r], 
for a suitable constant Ku depending only on DF{0), L, and r, and 

(4.6) \III\ < Knit for ah t G [0,r], 

(4.7) \IV\ < Kivt for ah t G [0,t], 
where again Kjjj and Kjy depend only on DF{0), G{0), L, and r. 

Therefore, summing (|4.4|) . (|4.5p . (j4.6|) . and (|4.7p . we obtain that there exist K and T' > 0, depend- 
ing only on DF{0), G{0), and L, such that 

(4.8) \g'{t) - g'Q{t)\ < Kt for all < t < T'. 

Let now iV = 3, and observe that owing to assumption (iv) each summand /, //, ///, IV , divided 
by t^, is bounded and a.e. differentiable, so that 

\g"{t)-g'^{t)\<K't for a.e. te [0,r'], 

where the constant K' depends only on DF{0), G(0), and L and so does T' ■ 

Observe that all the above constants do not depend on Therefore, invoking assumption (iii), 
we can apply Lemma [331 (for = 2,3), thus obtaining that there exists T > 0, depending only 
on G{0), DF{0), L, and N with all the properties (a), (b), (c), and (d), which are exactly those 
required to complete the proof. 

In the general case (i.e., 1 < M < N), it suffices to apply the above argument to each column of 
G. The proof is concluded. □ 

Remark 4.2. On the assumption N = 2 or N = 3. 

The restriction < 3 depends on our method for comparing the switching function g for 
the nonautonomous system coming from the linearization along an optimal trajectory, with the 
switching function for autonomous system obtained by linearizing at the origin. This comparison 
requires higher order derivatives of g, whose existence we are not able to insure if A > 3. □ 

5. Quantitative strict convexity of reachable sets and uniqueness of optimal 
controls: the nonlinear two dimensional case 

In this subsection, we will show that, provided the linearization at satisfies the normality 
condition and the nonlinear part is smooth and small enough, the reachable set is strictly convex 
up to a sufficiently small time. 



Theorem 5.1. Consider the control system 
(5.1) 



xit) = F{x{t)) + G{x{t))u{t), 
x(0) = 0, 
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under the following assumptions (in the following M is either 1 or 2): 

u{-) = {ui{-),um{-)) G [-1,1]^^ a.e., F : ^ G : ^ MaxM are of class C"^^ (with Lipschitz 
constant L) and 

(i) F{0) = 0, 

(ii) Rank [Gi{0),DF{0)Gi{0)] = 2fori = l,M where G = {Gi,Gm), 
(Hi) DG{0) = 0. 

Let TV denote the reachable set at time r > for ()5.ip . Then there exists T > 0, depending only 
on L, DF(0),G{0), with the following properties: 

(a) for every r <T and every x G bdryT^"^ there exists one and only one admissible control u 
steering the origin to x in time r (and u is bang-bang with finitely many switchings). 

(b) For every < t < T the reachable set TV is strictly convex. More precisely, for every 
xi G bdryT^"^ and X2 G TV , for every C, G N^-r{xi), one has 

(5.2) {C,X2-Xi) < -^\\C\\\\X2-Xif. 

where j is a positive constant depending only on L, DF{0), G{0). 

(c) There exist another time T' > T, depending only on L, DF{0), G{0), such that for every 
< T < T' the reachable set TV has positive reach. More precisely, for every xi G bdryT^"^ 



an- 



(i X2 G TZ'^ , for every ( G N.^r{xi), one has 



(5.3) (C,X2-xi) <y||C||||x2-xi 



|2 



where 7' is a nonnegative constant depending only on L, DF{0), G{0). 

(d) There exist another positive constant 7" and a positive time F" < T, depending only on L, 
DF{0), G{0), such that the ball 5(0, Y'r^) is contained in TV for all < t < T" . 

(e) The minimum time function is continuous in TV , for all < t < T" . 

Proof. We begin proving the result for M = 1, i.e., for a scalar control. 

Fix T > and xi G bdryT^"^, together with an optimal control ui{-) steering to xi and the 
associate trajectory xi(-). Take any X2 G 7^^ together with U2{-) steering to X2 and the associate 
trajectory X2{-), and set x{t) = X2{t) — xi{t). Then, for a.e. t £ [0,r], 

(5.4) xit) = Ai{t)x{t) + Gixiit))w{t), 

where w{t) = U2{t) — ui{t) and 

Ai{t)=[ DF{xi{t) + Tx{t))dT + U2{t) I DG{xi{t) + Tx{t))dT. 
Jo Jo 

Let z{-) be the solution of the linear system which is defined by linearizing along the optimal 

trajectory xi(-): 

f i{t)=A{t)z{t) + G{xi{t))w{t), 
\ z{0) = 0, 

where A{t) = DF{xi{t)) + DG{xi{t))ui{t). 
We have 

|||x(t)-z(t)|| < \\A,{t)x(t) - A{t)z(t)\\ 

< \\A{t)\\\\x{t)-z{t)\\ + \\A,{t)-A{t)\\\\x 

< Li\\x{t) - z{t)\\ + L\\x 



(5.5) 
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where Li = \\DF{{))\\ + 2Le^^''. 
Thus, by Gronwall's inequahty we get 

(5.6) \\x{t) - z{t)\\ < e^i*L /* Ms)f ds. 







On the other hand, observing that 



^lk(t)|| < L2\\x{t)\\ + L3\wit)\, 

(where L2 = \\DF{0)\\ + ALe^^^ and L3 = |G(0)| + e^^^) we also have 

ft 







(5.7) ||x(t)|| < Lae"^' / \w{s)\ds. 
From (|5.6p and (|5.7p . one obtains 

(5.8) \\x{t) - z{t)\\ < L4t(^J^ \w{s)\dsy, 

where L4 = LL|e(^i+2^2)T^ 

Since xi £ bdryT^"^, by Pontryagin's maximum principle there exists an absolutely continuous 
function A : [0, r] — )■ with the following properties 

\{t) = -X{t)A{t), A(r) = CeNTzr (xi), C ^ 0, 

(5.9) ui{t) = s[gn{Xit),Gixi{t))). 

We set now b{t) = G{xi{t)) and consider the linear nonautonomous control system 



(5.10) 



y{t) = A{t)y{t)+b{t)uit), 
y(0) = 0, 



together with the trajectory yi(-), corresponding to the control ui{-). Observe first that, thanks 
to ()5.9p . xi belongs to the boundary of the reachable set at time r for ()5.10p . Observe moreover 
that A{-) is measurable, and, since both F and G are Lipschitz with constant L and DG{0) = 0, 
we have 

\\A{t)-AiO)\\ = \\DF{xi{t)) + DG{xi{t))ui{t) - DF{0)\\ 
< 2L\\xi{t)\\ <2L\\G{0)\\e^^H. 

Finally, b'{t) = DG{xi{t))xi(t) so that 

||6'(t)- 6(0)11 = ||6'(t)|| < L||xi(t)||(2L||xi(t)|| + ||G(0)||) < Kt, 

where K = Le^^^ {2Le^^^ + l)||G(0)f . 

Therefore, all assumptions of Theorem 13.81 are satisfied by (|5.10p . so that there exists a time To > 
depending only on L, Z)F(O), G(0) such that if < r < To the following properties hold: 

i) ui{t) is uniquely determined by (|5.9p on (0,r), 

ii) there exists a constant 7(r) > 0, depending only on L, DF(0), G(0), r such that, for all 
trajectories ?/(•) of (|5.10p . {C,-,y{T) — yi{T)) < — 7(T)||?/(r) — 2/i(t)|P. More precisely, recalling 

(5.11) (C,y2(T)-2/i(T)) <-7i(t)( r\w{s)\dsy, 
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where y2{-) is the trajectory of (jS.lOp associated with the control U2{-) and 71 enjoys the 
same properties of 7. 

We remark (see (|3.29p ) that 71 (r) is bounded away from as r — )■ O"''. Moreover, one can see that 
z{t) = 2/2 (i) - yi{t)- Therefore 

{C,X2-xi) = {C,x{t)-z{t)) + {C,z{t)) 

(5.12) < \\x{t)-z{t)\\ + {C,z{t)). 
Recalhng (jS.Sp and (jS.lip . we obtain 

(5.13) (C,a;2-xi) < (L4r-7i(r))(^ |Tz;(s)|ds)'. 
Thus if r < hminf^_^Q+ 7(r) =: 71 then 

{C,X2-Xl)<-^(^l^\wis)\dsy. 

From this inequahty the uniqueness of the control steering the origin to xi in time r follows 
immediately by contradiction. Setting T = min{7o,71} and recalling (|5.7p we obtain ()5.2p . The 
proof of the strict convexity is completed by applying Proposition 17.31 
The proof of ()5.3p is entirely analogous, where it suffices to take T' = %■ 

We consider now the statement concerning the ball contained in the reachable set. To this aim, 
take ^2 = and set yi to be the solution of ()5.5p with ui in place of w. Then ()5.8p yields, for all 
t > 0, 

\\xi{t) - yi{t)\\ < ur^. 

Recalling (j3.4ip . we obtain from the previous inequality that 

\\xi{t)\\ > ||yi(t)|| -L4t^ >7^^-L4^^ 

for a suitable constant 7, which yields in particular that belongs to the interior of 7^*, < t < T. 
Since the above argument can be repeated for every point in the boundary of 7^* and the constant 
-L4 is independent of the reference point, the statement follows by recalling that we already proved 
that 7^* is convex for all < t < 7". 

The continuity of T follows easily from the the fact that reachable sets contain a ball (see, e.g., 
Propositions IV. 1.2 and IV. 1.6 in [IJ). 

In the case M = 2, it suffices to apply the above arguments to each control. □ 

The following Remark follows immediately from the proof of Theorem 15.11 

Remark 5.2. Let xi{-) and A(-) be as in the proof of Theorem \5.1[ For allO < t < t = T(xi), one 
has X{t) G N-jit(xi(T{xi — t))). More precisely, 

(A(t), y - xi(r(xi) - t)) < -7||A(t)||||2/ - xi(T(xi) - t)f 

for all y £ TV" , where 7 is the constant appearing in ()5.2p . 

In fact, put X{t) in place of C, in (j5.12p . Then the first summand can be estimated in the same way, 
while the upper bound on the second summand, namely the analogue of ()5.1ip . can be obtained 
through the same arguments leading to (|5.1ip . □ 

We conclude this section with a counterexample showing the sharpness of assumption (iii) in The- 
orem 15.11 
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Remark 5.3. An example of a two dimensional nonlinear control system satisfying assumptions 
(i) and (ii) of Theorem \5.1\ such that the reachable set TV is not convex for all t > 0. 



Consider the control system 
(5.14) 



Xl =X2{1+U) 

±2 = U, U £ [-1, 1]. 



Set F{xi,X2) = (2:2,0), G{xi,X2) = (x2,l), and observe that the assumptions (i) and (ii) of 
Theorem 15.11 are satisfied, while (iii) is not. The Hamiltonian for this system is 

n{{xi,X2), {pi,P2),u) = X2P1 + u{piX2 +P2), 

and Pontryagin's Maximum Principle states that if x(-) is an optimal trajectory corresponding to 
the control u{-), then there exists a function A = (Ai, A2), never vanishing, and a constant Aq < 
such that, for a.e. t, 

Xi{t) = Ai/0 

A2(t) = -{l + u{t))Xi 

X2{t)Xl + u{t){XiX2{t) + X2{t)) + Xo = 

u{t){XiX2{t) + X2it)) = maxn(AiX2(t) + A2(t)). 

u|<l 

Now, observe that 

XiX2{t) + X2{t) = Xl [ u{s) ds - Xit - Xl [ u{s)ds + X2{0) 



= -Ait + A2(0). 

Therefore the function XiX2{t) + X2{t) has at most one zero, so that the optimal control u is unique, 

bang-bang, and has at most one switching. 

Fix now r > and < s < 1 and consider the control 



1 0<t < ST 
-1 ST <t < T. 



Us{t) ■■ 

The trajectory of (|5.14p emanating from the origin and corresponding to the control U2 is, at time 



xl := xHt) = sV, xl := x^ir) = t{2s - 1). 

Simple computations show that any other bang-bang control with at most one switching cannot 
reach {x\,x1) at a time r' < r, for all < s < 1. Thus Ug is optimal. In particular, the curve 
7(5) := {x].,x1) belongs to the boundary of the reachable set TV . The unique unit normal to the 
curve 7(5) at s = 1/2 which points outside TV is 

c 

We compute: 



1 Orel's 
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which imphes that TU^ is not convex. Observe however that 717 has positive reach at 7(^) for every 
r > 0, since 



,1, 



1, 



□ 

Remark 5.4. On the assumption N = 2. 

Motivations for the restriction N = 2 are twofold. First of all, our analysis is based on the 
switching function of the nonautonomous system obtained by linearizing around an optimal trajec- 
tory, and this method requires < 3 (see Remark l4.2p . Second, the distance between trajectories 
of the nonlinear system ()5.ip and of the linearized system ()5.5p is of order two with respect to the 
control (see ()5.8p ). and this quadratic perturbation can be balanced by the strict convexity of the 
reachable set of the linearized system only if = 2 (see (|5.13p ). □ 

6. Further results for the nonlinear two dimensional case 

This section is devoted to proving that the epigraph of the minimum time function has positive 
reach, under the assumptions of Theorem 15.11 To this aim, a results of optimal points, i.e., on 
points which are crossed by an optimal trajectory, is needed. 

6.1. Optimal points. 

The classical definition of optimal point reads as follows. 

Definition 6.1. Let x G IR^\{0}. We say that x is optimal if and only if there exists a point xi 
such that T{xi) > T{x) and a control u with the property that y^i'"(-) steers xi to in the optimal 
time T{xi) and x = y^i'"(T(xi) — T{x)). 

The following is the result on optimal points which will be used in the next subsection in order 
to ensure the positive reach of the epigraph of the minimum time function. It is based on the 
same estimates which lead to the strict convexity of the reachable set, and so it is restricted to two 
dimensional control systems. 

Theorem 6.2. Let N = 2 and let the assumptions of Theorem \5.1\ be satisfied. Let T > be such 
that, according to Theorem \5.U for all < t < T , the reachable set TZ'^ of (|5.ip satisfies (|5.2p for 
all < T < T- Let x be such that T{x) < T. Then x is an optimal point. 

Proof. We consider first the case where G is a vector and the control u is one-dimensional. Set 
r = T{x) and let u{-) be the admissible control steering x to in the optimal time r, together with 
the associate trajectory x(-). Set, for all t E [0,r], 

A{t) = DF{x{t)) + DG{x{t))u{t), b{t) = G{x{t)) 

We assume preliminarily that x belongs to the boundary oiTV and let, by the Maximum Principle, 
A be a solution of 



■1) 



I \{t) = -\{t)A{t), 
\ Kr) = C 

where C £ ^Tv{^)-, C 7^ 0) and, for a.e. t G [0,r], 

(6.2) n(t) = sign(A(t),6(t)). 
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Set, for t E [0,t], 

g{t) = {X{t),b{t)). 

We are now going to extend «(•) in an interval [r, r + 6] for a suitable 6 > 0, with the property 
that the extended control and its associate trajectory satisfy the Maximum Principle. 
Three cases may occur: 

(i) 9{r) > 0, 

(ii) 9ir) < 0, 

(iii) g{T) = 0. 

In the first case, we set u{t) = 1 for all t > r and let x(-) be the associate trajectory satisfying 
x{t) = X. We extend analogously A{-), b{-), A(-) and g{-) for t > t. Set gi^r) := 5i. Observe that g 
is locally Lipschitz, so that, for t > t, 

g{t) = g{T) + g{t) - g{T) > 6i - Li{t - r) 

for a suitable constant Li. Therefore we can find 6 > such that < t + 5 < T and g{t) > for 
all t £ [r, r + (5], i.e., 

u{t) = sign g{t) G [t,t + 6]. 
The second case is entirely analogous, by substituting 1 with —1. 

We consider now the third case. Let the Jq, Ii be given by Lemma 13.51 for the function g in the 
interval [0, r]. Observe that necessarily r G /i, so that, in particular, ^'(r) / 0. We set, for t > r 

uit) = 1 if g'{T) > 

or 

u{t) = -1 if g'{T) < 

and let x{-) be the associate trajectory satisfying x(r) = x. We extend analogously A{-) , b{-) , X{-) 
and g{-) for t > t. Observe that 

m = {m,[F,G]{xm, 

where [F,G]{x) = DG{x)F{x) — DF{x)G{x) denotes the Lie bracket of F and G. Therefore g 
is continuous, so that there exists (5 > such that the sign of g{t) equals the sign of g(r) for all 
t G [t — 5^T + S\. Therefore our construction of u[-) on [0, r + (5] is such that for a.e. t G [0, r + 5], 

u{t) = sign g{t). 

Consequently, all conclusions of Theorem 15.11 hold up to the time t + 5. In particular, for all 
t G [0,r + 5], x{t) G bdryT^*. Since T(-) is continuous in a neighborhood of the trajectory x(-), we 
obtain that u(-) steers the origin optimally to x{t + 5) in time t + 5. Since the above argument can 
be applied also to the reversed dynamics x = —F[x) + G{x)u, u G [—1, 1], then T{x{t + 5)) = t + 5. 
Let us now drop the assumption x G bdryT^"^. Since T is strictly decreasing along the optimal 
trajectory x{-), and so x{t) G bdryT^'^"* for all < t < r, there exists a nontrivial adjoint vector 
A(-) which uniquely determines u{t) as in ()6.2p up to the time r. Thus the above argument can be 
applied also to x. 

If G is a 2 X 2 matrix, it suffices to perform the above construction for each column of G. The 
proof is concluded. □ 

We conclude the section with two corollaries. The first one is an immediate consequence of the 
proof of Theorem 16.21 
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Corollary 6.3. Under the same assumptions of Theorem 1 6. S\ let r = T(x) <t\ <T ■ Then there 
exists xi G bdryT^"^! and a control ui : [t, ti] — >■ [—1,1] such that the trajectory x(-) corresponding 
to the control 

u{t) < t < r, 

Ui[t) T < t < Ti. 

and such that x{0) = xi reaches in the optimal time ti and moreover x{ti — t) = x. 



u{t) 



From Corollary 16 . 31 we obtain that x{-) and A(-) in the proof of Theorem 16.21 can be extended up 
to the time T. Therefore, we obtain the following further corollary. 

Corollary 6.4. Under the assumptions of Theorem \5.1\ the maximized Hamiltonian along x(-) 
associated with A(-) is constant in [0,7"), i.e., 

H{x{t),X{t)) = C VtG[0,r). 

Proof. Let G be a vector and so the control u be scalar. Then 

H{x{t),X{t)) = {X{t),F{xm + \{X{t),G{xm\- 

Observe that the switching function g{t) = {X{t),G{x{t))) vanishes at most on a countable subset 
of [0,T). Therefore, for a.e. t G [0,7"), we have 
d 



^-H{x{t),X{t)) = i^ - {X{t),[F,Gmt))) + {X{t),[F,G]{xm)^mng{t) =0. 

If G is a 2 X 2 matrix, it suffices to perform the above computation for each column. The proof is 
concluded. □ 

6.2. The epigraph of the minimum time function has positive reach. 

The present section is devoted to studying the "convexity type" of the minimum time function T{-), 
in the case where the dynamics satisfies a weak controllability condition, i.e., the function r(-) is 
merely continuous. The statement is two dimensional, since it is based on Theorem 16.21 

Theorem 6.5. Let N = 2 and let the assumptions of Theorem \5.1\ hold. Let T he given by Theorem 
\5.1[ Then for every < r < T the epigraph of the minimum time function T(-) on has positive 
reach. 

Corollary 6.6. Under the same assumptions of Theorem \6.5\ the minimum time function T satisfies 
all the properties listed in Theorem\2.4\ 



Before beginning the proof of Theorem 16.51 we introduce the minimized Hamiltonian and study 
its sign. 

Definition 6.7. Let x,C G M^. We define the minimized Hamiltonian for the control system in 
(I5TD as 

h{x, C) = (C, F{x)) + min(C, G{x)u). 

Proposition 6.8. Let x belong to the boundary of the reachable set TZ'^ for (|5.ip for some r > 0. 
Let C G N^r{xQ. Then h{x, () < 0. 



-'^here N^t{x) denotes the Frechet normal cone to TZ'^ at x, i.e., all vectors v such that limsupj^T^y^^{v,{y 
x)/\\y-x\\)<0 
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Proof. Let u{-) be an admissible control steering x to in time r, together with the associate 
trajectory x{-). Then, for all < t < r the point x{t) belongs to TZ'^, so that, by definition of 
Frechet normal we have 

/ ^ x(t) — X \ 
hmsup (C,Trrr^ u) < ^■ 



\x{t) — x\ 



Observing that \\x{t) — x\\ < Kt for a suitable constant K, we have 

/ ^ xit) — x\ 

hmsup (C,-^^^ > < 0. 

t^o \ t I 



In other words. 



> limsup/c- / {F{x{s)) + G{x{s))u{s))ds 
t^o \ t Jq 



{C,F{x)) + Hmsup (CGix) 



t-s>0 



, /o u{s)ds 



Let i„ — )• be a sequence such that lim.n~^oo j- Jq" u{s)ds := u exists. By the convexity oiU, u £ U, 
and so h{x, () < {C, Fix)) + {(, G{x)u) < 0. □ 



We are now ready to prove Theorem 

Proof of Theorem 16.51 Let x 7^ be such that T(x) < T and let («(•), be an optimal pair 
for X. By Maximum Principl^ there exists ^ C £ N-jiTix) {x) such that the adjoint arc A, with 

f \{t) = \{t)[DF{x{t)) + DG{x{t))u{t)), 

\ A(r(x)) = c 

satisfies 

{\{t),F{x{t)) + G{x{t))u{t)) = h{x{t),\) fora.e. tG(0,T(x)). 

We claim that 

(6.3) (C,M^,C))G<i(T)(^,3-(^)): 



i.e., there exists a constant a > such that, for all y G M with < T{y) < T and for all /3 > T{y), 
we have 

(6.4) ((C,0),(2/,/3)-(x,T(x))> <a||(C, 0)11 + 1/3- T(x)l), 
where 9 = /i(x,C), and, moreover, 

(6.5) a is independent of x and C- 

Indeed, we consider two cases: 

(a) T{y) < T{x); 

(b) T{y) > T{x). 

In the first case, y G TZ'^^^\ so that by Theorem 15.11 

{C,y-x)<0. 

If /3 > T{x) then ()6.4p is automatically satisfied, since < by Proposition l6.8l If instead /3 < T{x), 
we set xi = x{f3). 



^observe that we are applying Theorem 12.61 for the reversed dynamics x = —F{x) — G{x)u 
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We estimate first (C, y — xi). Since y G TZ^^ , recalling Remark[521 we have for suitable constants 
Ki,K2 given by Gronwall's Lemma, 

(C,y-xi) = (A(/3),y-xi) + (A(r(x))-A(/3),2/-xi) 

< (A(r(x)) - m,y- xi) < K,\\XiT{x))\\ \T{x) - /3\ \\y - 

< i^i||A(r(x))|| |r(x) - /3| (||y - x\\ + ||xi - x||) 

< i^illCll \T{x) - f3\ {\\y - x\\ + K2\Tix) - f3\) 

< Ks\\C\\{\\y-x\\' + \Tix)-P\') 

for another suitable constant K3. 

Second, we estimate {C,xi — x). We have 

iCxi-x) = r''\x{T{x)),F{x{s)) + G{x{s))u{s))ds 

J/B 

T(x) 

(A(s), F{x{s)) + G{x{s))u{s)) ds 

l-T(x) 

+ / {\{T{x))-X{s),F{x{s)) + G{x{x))u{s))ds 

h 

< {T{x) - (3)h{x,C) + K4C\\\T{x) - 

for a suitable constant K/j^, owing to Corollary 16.41 (applied to the reversed dynamics x = —F[x) — 
G(x)u). Therefore, since h{xC,) < 0, 

((C, e), (y, /3) - (x, r(x))) < (Ks + K4)||CII (l|y - xf + \T{x) - , 

and the proof for the case (a) is concluded by observing that K3 and are independent of C and 

X. 

In the second case we need to use the optimality of x. We observe first that, since 9 < 0, we only 
need to prove ()6.4p for /3 = T{y). Recalling Corollary [631 we can extend the control u up to the 
time T{y) so that the associated trajectory (still denoted by x(-)) remains optimal. Let also A be 
the extended adjoint vector and denote by x(-) the trajectory of the reversed dynamics associated 
with the extended control u, i.e., 

f S:{t) = -F{x{t))-G{x{t))u{t), 

\ m = 0, 

where u{t) = u{T{y) — t). 

Set xi = x{T{y)). We estimate first {C,,y — xi). We have, by arguing similarly as before, 

(C,2/-xi) = (A(r(y)),2/-xi) + (A(T(x))-A(r(y)),y-xi) 

(the first summand is < by the construction in Theorem 16. 2p 

< (A(r(x))-A(r(y)),y-xi) 

< KMi\T{y)-T{x)\^ + \\y-x,f). 
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On the other hand, 

rTiy) 

iCxi-x) = / {C,-F{i{s))-G{x{s))u{s))ds 
Jt(x) 

rT{y) 

= / {\{s),-F{5:{s)) -G{x{s))u{s))ds 

Jt{x) 

fT(y) 

+ / {X{T{x))- X{s),-F{x{s))-G{x{s))u{s))ds 
Jt{x) 

rT{y) 

< / max{X{s),-F{3:{s))-G{x{s))u)ds + KM{T{y)-T{x)f 

Jt{x) "6" 

(for a suitable constant Kq given by Gronwall's Lemma). 

Recalhng CoroUary 16.41 the maximized Hamiltonian in the integral of the first summand is 
constant. Therefore we obtain 

(C, xi-x)< -h{x, C)(r(y) - T{x)) + i^ellCll - T{x)\\ 

Combining the above estimates we obtain finally 

ace), {y,T{y)) - (x,r(x))) < {K, + K6)||Cll(l|y + \T{y) - T{x)f), 

and the proof of the claim is concluded, by observing, again, that K^,Kq are independent of x and 

C- 

In order to conclude the proof we observe that N^^^j,^ is pointed at every point {x, T{x)), x G TZ'^, 
since it is easy to see that the projection of every (C)^) £ -^(^i(r)(^' -^(^)) o^to is normal to 
the strictly convex set TZ^ . Therefore, we can apply Corollary 3.1 in with flp = intT^^, which 
shows that epi(T) has positive reach. □ 

7. Appendix 

This section is devoted to some technical lemmas which are used in the proof of the main results. 

Lemma 7.1. Let K : (a, b) — t- [0, 1] he measurable and let /c G N. Then 

1 / /"^ \k+i 



[t-afK{t)dt>^[j^ K{t)dt) 
and 

j\h -t)^K{t)dt>^[j'^ K{t)dt) 



Proof. Indeed, 

/•b rb rh i-b 

{t- afK{t)dt = kl ■■■ K{to)dto . . . dtk. 

J a J a J tj^ J t\ 

Since K(t) E [0, 1] for a.e. t G [0, 1], we obtain that 

l\t-afK{t)dt>k\ f K{tk) f K{tk-i)... [' Kito)dto. 
One can easily prove that 

/■^ rb rb I , rb fc+i 

J K{tk) K{tk-i)...J^ K{to)dto...dtk = j^^[J K{t)dt) 
The proof is complete. □ 



dtk 
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Lemma 7.2. Let / : [a,6] — )■ M be absolutely continuous and monotone. Fix k > and assume 
that there exists C G such that 

(7.1) \f{s)\>C{s-af VsG[a,6]. 

Then, either f has no zeros in (a, b) and then, for all s £ (a, b) either 

\f{s)\>^{s-a)''+' or \f{s)\>^{b-s)''+\ 

or there exists c £ {a,b) such that f{c) = and then, for all s £ [a,b], 

i/(»)i>^i.-.r' 

The same conclusions hold if ^7.1\ ) is substituted by 

\f'is)\>Cib-s)' ysG[a,b]. 

Proof. We treat the case where / is nondecreasing, while the other one can be handled by 
taking — /. So (|7.ip now reads as 

f'{s)>C{s-a)'' VsG[a,6]. 

If / has no zeros, we have two cases, namely f{s) > for all s G (a, b) or f{s) < for all s G (a, b). 
For the first case 

f{s) - f{a) = r nt)dt > C [\t - afdt =r^{s- af+\ 



k + l 



so that 



In the second case, 



/(.)>^(.-ar'. 



/(i-) - /(») = / rmt >c f (t- afdt 

J S J S 



Therefore, 



f{s) < f{b) - - sf^' < -^{b - sf^\ 



Assume now that there exists c G (a, b) such that /(c) = 0. Then, for all s G [a, c] we have 

-f{s) = f{c) - f{s) = rm > ^(c - sf+\ 

while for all s G [c, b\ we have 

/(») = /(s) - /(c) = >^[(»-«)'+'-(c -«)'+'] 

and the proof is complete. □ 
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Proposition 7.3. Let K C he compact and assume that there exist 7 > and p > \ with the 
following property: for every x G bdry K , there exists C 7^ such that for every y £ K one has 



(7.2) (C,y-a;)<-7llCIII|y-^l 



p 



Then K is convex (with nonempty interior) and, for each x G bdryi^, (7.2) is satisfied by all 

Proof. We show first that K is strictly convex. To this aim, assume by contradiction that there 
exist points xi ^ X2 £ K such that the segment ]2;i,X2[ is not contained in the interior of K. Let 
< t < 1 be such that Xt = {1 — t)xi + tx2 G bdryiC and let C 7^ be such that (|7.2p holds with 
xt in place of x. Obviously, {(,^2 — xi) = 0, and this is a contradiction. Since K is convex with 
nonempty interior, for each x £ bdryi^ the normal cone Nk{x) is pointed and so it is the convex 
hull of its exposed rays (see [T5]). 

We now use Theorem 4.6 in [llj and see that for every unit vector w belonging to an exposed 
ray of Nk{x), there exists a sequence x„ — >• x such that 

^Kixn) = ll^nll = 1 and Wn — )• vu. 

Of course (|7.2|) holds with x„ (resp., Wn) in place of x (resp., C), so that by passing to the limit, w 
also satisfies ()7.2p . By taking convex combinations, we conclude the proof. □ 
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